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Abstract 

It  is  an  open  problem  to  construct  a  test  for  structural  relationship 
among  the  mean  vectors  of  several  multivariate  normal  populations  with 
known  but  unequal  covariance  matrices.  In  this  paper,  a  class  of  admissible 
Bayes  tests  for  the  above  problem  is  derived.  As  a  byproduct,  in  the  special 
case  of  known  and  equal  covariance  matrices,  the  likelihood  ratio  test  of 
Rao(r)73)  is  shown  to  be  admissible  Bayes. 
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1.  Introduction.  Fisher(1939)  pointed  out  the  importance  of  tests 
for  structural  relationship  among  the  mean  vectors  of  several  multivariate 
normal  populations.  To  be  specific,  consider  k  independent  p-variate  multi¬ 
normal  populations,  A^p(p,,E,),  i  =  and  the  problem  of  testing 

(1.1)  Hq  :  Hfi,  ---  ^  ,t  =  I.--,  A:  vert^us 

Hi  :  arbitrary 

where  //  :  s  x  p  is  an  unknown  matrix  of  known  rank  s  p  and  ^  is  an 
unknown  s-vector.  The  hypothesis  Ho,  if  true,  implies  that  the  k  mean  vec¬ 
tors  Pi ,  ■  ■  • ,  p*  lie  in  a  (p  -  s)-dimensional  subspace  of  the  Euclidean  p-space 
E'’  rather  than  in  E^'  itself,  and  provides  a  structural  relationship  among 
the  mean  vectors.  As  Fisher(1939)  and  Rao(1973)  rightly  emphasized,  it  is 
essential  that  in  dealing  with  several  multinormal  populations  a  hypothesis 
of  the  form  (1.1)  be  tested  prior  to  using  the  models  for  prediction  etc. 

It  is  an  open  problem  in  the  literature  to  construct  a  suitable  test  for  the 
hypotheses  in  (1.1)  based  on  independent  samples  from  the  k  populations 
when  E] ,  •  ■  • ,  E*  are  unequal.  In  the  ca.se  when  E] ,  •  ■  ■ ,  E*  are  equal  (and  = 
E,  say),  Rao(1973)  derived  the  likelihood  ratio  test  (LRT)  of  Hi,  against  Hi 


which  rejects  the  null  hypothesis  for  large  values  of  T  =  ^  *).  Here 

1=1 

B  is  the  matrix  of  the  sums  of  squares  and  products  due  to  the  hypotheses 
(between  groups),  A]  <  Aj  <  •  •  ■  <  Ap  are  the  ordered  roots  of  and 

the  natrix  E  is  assumed  known.  If  E  is  unknown,  one  replaces  E  in  the 
detiaition  of  T  by  W ,  the  within  matrix  sum  of  squares  and  products  due 
to  error  (within  groups).  That  the  resultant  test  is  the  LRT  is  proved  in 
FuJikoshi(197‘l)  and  also  in  Rao(1985). 

It  is  the  object  of  this  paper  to  provide  a  simple  solution  to  the  above 
open  problem  when  Ei,'  -.E/^  are  assumed  known.  We  have  derived  in 
Section  2  a  class  of  admissible  Bayes  tests  for  the  hypothesis  Hn  versus 
H\.  Interestingly  enough,  inspite  of  the  somewhat  complicated  structures 
of  the  model  and  the  problem,  the  derived  tests  are  of  extremely  simple 
form.  In  the  special  case  of  equal  ami  known  covariance  matrices,  the  LRT 
of  Rao(l973)  is  shown  to  be  admissible  Bayes. 

We  may  recall  that  a  Bayes  critical  region  (for  0  1  loss  function)  is  of 

the  form 

(1-2)  {x  :  j  f(x  j)n,{ild)  j  f(x-.0)nn{(lO)  ■  e} 

for  some  positive  constant  c.  where  f(x;0)  is  th«>  underlying  joint  density. 


2 


0  is  the  vector  of  parameters,  tti  and  ;r,)  are  the  prior  probability  measures 
over  the  alternative  parameter  space  0]  and  the  null  parameter  space  0o 
respectively,  and  /  is  over  the  respective  parameter  spaces  (Kiefer  and 
Schwartz,  1965).  Assuming  that  we  have  available  a  random  sample  of  size 
n,  from  the  ith  population,  denoted  as  x,i,  •  •  •  ,x,n_,  t  =  1.  ■  ■  ■ ,  k,  wc  can 
write 


(1.3)  f(x-J)  =  (27r)-P'^ni--'"'  '(X.  -M.) 

t=l 

k 

■  (x,  -  ^,y}etr{  1  2  ^  L',  ’5,} 


j  n,  n, 

where  X,  =  E(^o  ‘  X,)(x,;  -  x,)'.  t  -  \  .-  -,k. 

”'j=i  ;=i 


k 

n  =  E  ^  (Mi.  •  ■  •  -  M*),  0  =  {(/<!.  •••  .M*)  :  Mt  *  ■  U  -  ■  ■  .k}. 

1  =  1 

0(j  =  {(mi,  ■  •  •  ,Mit)  •  ~  *  1.  •  •  • . /r,  //  :  s  ■  p  unkvown , 

rank(H)  =  s  <  p,  s  known,  ^  s  ■  I  ^  E^’  unknown},  0]  =  0  -  00- 

k  k 

In  what  follows  the  factor  (27r)  "'’  ‘  ISJ  "'''eirl  -  1 '2^^  I!,  'S',}  ap- 

1=  1  1  =  1 

pearing  in  /(x;0)  is  ignored  because  it  is  independent  of  9  and  has  no 
influence  on  Bayes  tests  of  the  form  (1.2).  Thus  one  can  write  (1.2)  in  the 
form 


(1.1)  {x  :  /  /•(x;6»);r,(r/tf),  J  f{x-,9)Mde) 


'  c} 
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where 


k 

(1.5)  /'(xitf)  ^  eir{-l/2X]n,E,“*(x,  -  /x.)(x,  - 

1=1 

Appropriate  choices  of  ttj  and  irn  are  made  in  Section  2  and  the  resultant 
Bayes  tests  are  derived. 


2.  Admissible  Bayes  tests  of  (1.1).  Under  the  alternative  Hi.  we 
choose  TTi  as  the  absolutly  continuous  measure  on  the  space  of  the  /x,'s 
given  by 


(2.1)  dTTiiiii.-  ■  •  .|/*)  ■■■diUk  ^ 

(2t)  '(EnJ^  V/rl  -  l/2Y:n...l,-'(M.  ■  C.)(//.  -  C.)'} 

i-i  1=1  1=1 

where  A,  :  p  ■  p.  p.d.  matrix,  and  Ci  ;  p  ■  1  vector,  i  -=  Clearly 

TT]  corresponds  to  choosing  independent  normal  priors  for  each  p,.  The 
matrices  ,4,  and  the  vectors  i  -  will  be  chosen  later.  This 

immediately  results  in  the  numerator  of  the  expression  in  (1.4)  as 

(2.2)  /  r(x-.e]ni(de)  ^ 

(27r)^P*'^(n  n.)^^‘ n  I  A.r 1/2  ^  n.  V  ‘x,x:} 

1=1  1-1  1-1 
k 

1  =  1 


) 
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t  =  l 

i:=l 

•(E.-‘x.  4-  4  /tr‘)-'(E;>x.  ^r'c.))'} 


■dni  ■  ■  ■ 
* 


--  ni^.  +  /pi  ‘'^eir{-l;2^n./l.-'c.c:} 

1=1  1=1 
k 

■etr{  -  1/2  ^  n.Ef ‘x.x,’} 

1  =  1 

•e«r{l  2^n,(i:,-‘x,  4- /I,  ‘c.)(S."‘x,  4- ^^1/')''} 


t=i 


The  crux  of  the  problem  now  is  to  evaluate  the  denominator  of  the 
expression  in  (1.4).  namely  /  /' (x;  <?)7rn(c/^)  for  suitable  tto's.  Towards  this 
end,  first  note  that 


(2.3) 


for  arbitrary  r/,  £’’’ 


so  that  0ti  can  be  rewritten  as 

(2.4)  00  =  {(mi.  •••,M*)  :m.  =  //'{////')  (/p 


T),  E^,i-  1.---.A:,  f.rii.- ■■  ,rii^  all  arbitrary , 


H  :  s  ■  p  un  kvoirn .  r(ink[  H )  .s  p.  .s  known}. 

Our  choifo  of  tto  oii  O,,  rorrc'spotids  to  clioosiug  suitablt'  priors  for  H  V 
{H  :  s  ■  p  rank{H)  s},  K'  and  p,  E’’ .  i  \.  --.k.  Throughout 
the  following,  as  far  as  II  is  ( otu  crned ,  W('  assume  that  tt,,  assigns  all  its 


measure  to  the  subsc- 

i  •( 

(// 

s  p  //  (/.  :  ())}  of  V.  It  remains  to 

specify  priors  of  ^  ;c't> 

>  '/!• 

'Ik 

This  is  done'  bc'low 

Choose  t  h*‘  rondit 

lotial 

den''it  \ 

'Tip,.  •.  pt).  given  as 

(2. .5) 

■  Pk  i 

)  dp,  ■ 

dp,  (2;r)  6'  1  2 

1  ) 

c/r{  1  2 

k 

/’,  Up, 

(P,  •  A,i))(p,  (p)’  • 

>  I 


and  the  marginal  density  of  ^  as 

(2.6)  dn,{^)  (2T)'-(/Wr{  l2Q  '(i  £")'} 

where  :  p  •  1.  :  s  •  1.  A,  :  p  -s.  :  p  •  p,p.d..  Q  .  ■  .'^.p.d.  arc'  to 

be  suitably  chosen.  Let 

d,  ‘x,.  i  -  1.  •  •  ■  ./r. 

k  k 

1^1  I  I 

vyi  -  (/,  :  0)  :  .S  •  p. 
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(2.7) 


^2 

_ 

1 

0 

\ 

0 

:  p  ■  p 

0 

\ 

t...  J 

'I'3 

t  =  i 

n.7;, 

')'!'',  :  5  .  s. 

'I'4. 

=  ' 

V{/._.  ; 

p  ■  p.  i  ^  ■ 

■,k 

'1^5. 

■= 

M/',  : 

P  ■  .s,  1  ~  \  .  - 

•  ,  k 

Then  the  denominator  of  the  expre.ssion  in  (l-  l)  can  be  simplified  as 
(2.8)  /  /•(x;tf)7ro(dtf)  - 

(2tr)-f'*'-(nn.)'’  'niP.r'  -(27:)  '  -gr'- 

1  =  1  1-^1 

•efr{  -  1  2  ^  n.i:,  'x.x',}e/r{  1  2g 

l-l 

■€tr{  -1,  2 

I-.1 

•/ etr{  1  2(v{/3  ^g  ')s^^  -  1  2(v|/,J  »  Q  'c'’)c' 
fl /2^('i/,/;f  ^g  'a'} 

it 

•etr{  -  l/2^n.[('I'^.  +  P,  Mb.h,'  'I's.s  * 

1=1 

pr^w:  +  A.o)h:  ^  p.  'w:  -  } 

t 


■d^drji  ---dTj^ 


K 


and 


(2.10)  T 


i~l 

+  XI«.(pr'^.  -  +  pr‘)  '('i'2^.  +  f’r'n':). 

1=1 


In  the  above  A,’s.  P,'s,  and  Q  are  chosen  so  that  E  is  p.d...  Hence, 
combining  (2.2)  and  (2.8),  and  taking  tlie  logarithm  of  the  ratio  of  the 
expressions  in  (2.2)  and  (2.8),  the  Bayes  test  turns  out  to  be  of  the  form 

k. 


(2.11)  fr{^n.(: 


■‘x,  +  /I, '(:,)( +  a,  'c, )'(!:,  ’ 


•i,  ')■’} 


1  =  1 


tr{rr'E-‘} 

1 

c  , 


VVe  now  choose  l\.  Q.  A,.  i/('.  and  Ci  suitably  subject  to  E  being 

p.d.  to  reduce  (2.11)  to  a  nice  form. 

Let  E,  be  partitioned  as 


(2.12) 


•—'I 


I 

V 

--t(ll)  -xd'J) 
^■(21)  -1(22) 


\ 


/ 


where  E,(n)  :  s  '  s,E,{22)  ^  (p  -  -s)  ‘  (p  “  ■'=).  and  let  E,  '  be  similarly 
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partitioned  into 


(2.13) 


V  > 


vii  vi; 


V21 


where 


I 

-1(11  Ji 


V"  I  I 

— 1(22)— .(II  ;( 


''  V  •  ''  an.)  '' 

-^.1  Jl  I  AMU  ^,(  '1 


V  1  1 

— .( 1 1  |-t( 


.(11  :i  -.(HI  -.(12)-, CHI 

I,  •  .A-. 


M22  I! 


.(22  H  —.(221 


r  V  •  V'  , 

-.I21)-,(ii|->(IH.  > 


(’hooso 


(') 


.(III 


0  1.122  I 


.  I  1, 


k. 


where  t.<  (irnj  s  •  s.  p.d.  rnntnr: 


Q  ^'.1. 


'  )  '• 
(111) 


HI 


.(111 


-.1  121 


V 

-.(211  -.(22) 


.  I  \.  .k: 


(h.) 

A, 

/'.'J'l.. 

1  1 .  ■  ■  ■  ,  A' ; 

('•) 

f" 

S 

k 

1  1 

('•») 

Cl 

.1.(1, ' 

‘  .1,  ')'^2('»'..  •  /’.  ’)  ')/ 

and  (I’u) 

n 

n,' 

1  1 .  ■  •  • 

,/c,  arhitray. 

10 


It  may  be  noted  that  E  simplies  to 


(2.14)  E 


=  'I's  +  +  ^n,vI/5,P,xI/5. 

t=l 

i-i 

=  +  s‘^s.(22  .)i:r ) 

.) 


1=1 


+  ^1*  _  r-i 


t  - 1 


1  =  1 


which  is  clearly  p.d.  and  f*i(u)  does  not  affect  the  calculation. 

The  three  terms  appearing  in  the  left  hand  side  of  (2.11)  can  now  be 
evaluated.  Combining  the  first  term  and  the  second  term  of  (2.11)*  and 
using  (rt).  we  have 


Mo 


1=1 


1-1 

k 


I 

k 


)■'  -  'I'2('i'4. 

+  P.-' 

-•■V)  ' 

+  pr 

1.  >)  '.4.  > 

C.  'J'2('1'4.  ' 

pp') 

*  .4,  ') 

.1  '1  o'  I) 

'‘('I'4. 

‘  p:'r'p, 

•  .  •  ^  .1,  ' 

)  '  -  '1'2('^4. 

-  P.  ' 

X  3  1 


I  1 


Since  the  second  term  of  the  last  equation  does  not  contain  data,  we  may 


drop  it.  So  (2.15)  is  now 


(2.16)  tr{X:n.(E.-‘x.)(E.-'x.)'((E.  ■  4  .4-')~‘  'I'2('I'4.  +  P.'')  ' '1'2) } 


=  <r{l/2^u.(Er‘x,)(S.'*x.)' 


^1(112)  0 


0  0 


0  ^t(22l)  I  1  0  S^:|22 


=  tr  ^  l/2X^n.(E,“‘x,)(E,-'x,)' 


E,(  1121  0 


0  0 


Also,  using  (tj),(ti')  and  (i»).  the  third  term  of  (2.11)  reduces  to 


(2.17)  tT{rr 


fr{l/2(vl/,d)(v{/,/l)'(^n.E:')  *} 


,  (ELin.Ey)  '  0 


=  tr  {  l/2f3g 


=  {  l/2(zL]«.-r'x.)(X]^>-.  ’x.)' 


(i:f-.n.E,‘-)  '  0 
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Clearly  P,(ii)  does  not  affect  the  above  calculations.  Combining  (2.16)  and 
(2.17),  (2.11)  is  now  of  the  form 


(2.18)  tr 


tr  < 


Vn.(E;'x.)(E;'x.)' 
1  =  1 


(£n  v-‘x.)(E^.^r'x.)' 

1=1  1=1 


\ 

] 

^t(ll  2) 

0 

0 

0 

0  0 


This  immediately  prove  the  following  result. 

Theorem  2.1.  An  admissible  Bayes  test  of  (LI)  rejects  //,,  for  larye 
values  of  the  test  statistic  given  by  the  left  hand  side  of  (2.18). 


When  are  equal  (and  E,  say).  (2.18)  reduces  to 


( 

k  k  k 

0  0 

(2.19)  tr  • 

(^H.x.x,'  -  l/n(^n,x.)(Xin.x|)) 

v-i  . 

t=l  1=1  1=1 

V 

0 

tq 

1 

c. 


which  is  the  same  as 


(2.20) 


tr  ■ 

B 

/ 

v-i  _ 

\ 

0  0 

\ 

n  ' 

0  ^2,  ^ 

c 


where  B  is  defined  earlier. 


This  leads  to  the  following  important  result. 

Theorem  2.2.  An  admissible  Bayes  test  of  (l-l)  when  Hi 
Hit  -  H  rejects  Hn  for  large  values  of  the  test  statisitr  given  by  the  left 
hand  side  of  (2.19)  or  (2.20). 

Remark  2.1.  It  is  interesting  to  observe  that  the  test  statistic  given 
by  the  left  hand  side  of  (2.19)  can  h<>  interpreted  as  the  sum  of  the  first  .s 
roots  of  the  matrix  CH  This  follows  because  one  can  alwa\  s  take  H  -  /,, 
due  to  the  nature  of  the  hypotheses  (l.l)  and  change  B  to  H  '  ‘/iH  '  '. 

Remark  2.2.  It  is  clear  from  the  preceding  calculations  that  if.  under 
Ho.TTn  is  chosen  as  assigning  all  its  measure  to  the  subspace  V,,  of 


the 

form  k,, 

,1  • 

.  {H 

:  s  ■  p  11 

(0  l.,()  1, 

i:  •■I,.- 

■  0).  1,^ 

(0. 

■  •  1  ••  0)' 

:  5  ■ 

1  with 

1  at  the  jth 

position*  1  1 1 

....  , 

.  p}-  a 

appropriate  changes  are  made  accordingly  in  th<>  definitions  of  'k'|.  4'^,  and 
also  in  the  choice  of  P,.Q.  .4,  etc.,  in  the  above  priors  of  J  and  i;i,  ■  .  r/*.. 
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*  1  and  1  as  the  i.th  column  of  H, 


0  0  0 

0  (Ef., ■  0 

0  0  0 

whore  ^,(ii  2)  is  the  appropriate  s  '  s  proper  subinatrix  of  D,  corresponding 
to  the  rows  (ii.  and  the  columns  (z, Iri  the  special  case 

of  the  equality  of  it  therefore  follow's  from  ('2.21)  that  a  test 

w'hich  rejects  //o  for  large  values  of  the  sum  of  any  s  roots  of  ZiE  ‘  is 
admissible  Bayes.  In  particular,  the  likelihood  ratio  test  of  Rao(l97.'l)  for 
equal  covariance  matrices  which  rejects  W.i  for  large  values  of  the  sum  of 
smallest  roots  of  /Zli  '  is  admissible  Bayers. 
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